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ABSTRACT 

Many  techniques  are  available  for  the  esti¬ 
mation  of  the  power  spec t nun  of  a  stationary 
randcai  process.  Mhile  power  spectrum  estimation 
is  a  problem  which  falls  within  the  domain  of 
signal  processing,  the  problem  of  inferring 
information  falls  within  the  domain  of  artificial 
intelligence  (AI).  With  a  wide  variety  of 
different  types  of  power  spectrum  estimation 
techniques  to  choose  from,  an  equally  wide  range 
of  differing  spectral  estimates  may  be 
produced.  Each  estimate,  however,  may  be  used  to 
infer  information  about  the  time  series.  By 
defining  an  appropriate  knowledge  base,  a  system 
is  being  developed  to  infer  information  from 
power  spectrum  estimates.  This  system  combines 
the  estimates  produced  by  a  variety  of  current 
spectrum  estimation  techniques  in  order  to  formu¬ 
late  a  composite  spectral  estimate. 


iwimowciinm 

The  integration  of  signal  processing  with 
artificial  intelligence  (AI)  is  not  a  new  idea. 
In  fact,  the  merger  of  both  of  these  disciplines 
is  proving  useful  in  applications  where  the  goal 
is  the  symbolic  description  of  a  signal  or  the 
extraction  and  recognition  of  signal  features. 
Systems  which  presently  apply  artificial  intelli¬ 
gence  to  signal  processing  Include  HEARS AY -I I 
(1],  SIAP  (2],  and  the  dipmeter  advisor  (3).  In 
this  paper,  we  describe  some  preliminary  work  on 
the  development  of  a  system  which  applies  AI 
techniques  to  the  problem  of  estimating  the  power 
spectrum  of  a  stationary  random  process.  In 
particular,  the  general  philosophy  and  structure 
of  a  Knowledge-Based  Spectral  Estimation  (K-BASE) 
program  is  overviewed. 

Although  many  signal  processing  techniques 
have  been  developed  for  estimating  the  power 
spectrum  of  a  stationary  random  process,  each 
produces  a  different  estimate  of  the  power  spec¬ 
trum  [4].  Mhile  these  estimates  may  be  quite 
different,  each  sheds  light  on  the  underlying 
characteristics  of  the  random  process  and  pro¬ 
vides  useful  information  about  the  true  power 
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spectrum.  The  goal  of  our  K-BASE  program  is  to 
extract  the  relevant  pieces  of  information  from 
each  of  these  estimates  to  form  a  composite 
description  of  the  power  spectrum.  Thus,  for  any 
given  spectrum  estimation  technique,  the  underly¬ 
ing  assumptions  concerning  the  signal  generation 
process,  the  inherent  strengths  and  limitations 
of  the  technique,  and  the  signal  features  or 
model  parameters  produced  by  the  technique  are 
viewed  as  the  knowledge.  Collecting  these  pieces 
of  knowledge  together,  a  knowledge  base  is  pro¬ 
duced  which  forms  the  foundation  for  the  K-BASE 
program.  A  control  strategy  is  used  to  guide  the 
search  through  the  space  of  possible  solutions. 
The  information  in  the  knowledge  base  is  used  to 
make  Inferences  and  deductions  about  the  true 
power  spectrum.  Such  a  system,  therefore,  is 
able  to  draw  upon  the  strengths  of  each  of  the 
power  spectrum  estimation  techniques  to  derive  a 
spectral  estimate  in  a  data-adaptive  and 
’intelligent*  manner.  with  this  knowledge  base 
and  control  structure  it  is  also  possible  to  make 
inferences  and  apply  various  signal  processing 
techniques  to  test  the  validity  of  these 
inferences. 

In  the  following  sections,  we  overview  the 
structure  of  the  K-BASE  program.  First,  we 
describe  the  contents  of  the  knowledge  base  which 
is  divided  into  four  knowledge  domains  and  pro¬ 
vides  the  ’intelligence*  of  the  K-BASE  system. 
Then  we  describe  the  control  strategy  which  draws 
upon  the  knowledge  base  to  direct  the  search 
through  the  problem  space  to  reach  the  desired 
goal  of  the  program,  i.e.,  the  description  of  the 
power  spectrum.  Finally,  we  describe  a  prototype 
system  being  developed  which  focuses  on  a  problem 
of  limited  scope  by  restricting  the  sise  of  the 
knowledge  base. 


K-BASB  ROOUM 

Me  are  currently  in  the  preliminary  stages 
of  devsloping  a  Knowledge-Based  Spectral  Estima¬ 
tion  (K-BASE)  system.  The  purpose  of  this 
program  is  to  develop  a  prototype  system  to  find 
the  power  spectrum  by  using  information  gained 
from  a  set  of  spectral  estimation  techniques. 


*Thls  work  was  supported  by  the  Joint  Services  Electronics  Program  under  contract  IDAAG29-S1-K-0024. 
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The  key  ces^onents  of  th«  K-BASE  program  arc 
the  knowledge  domains  required  for  spectral  esti¬ 
mation,  tha  oontrol  at r a tag las  for  r a  aching  tha 
final  goal  and  tha  methods  uaad  to  determine  whan 
tha  final  goal  is  reached,  and  a  raprasantatlon 
of  tha  knowladga.  Due  to  tha  larga  amount  of 
information  availabla  on  powar  a  pact  run  esti- 
■ation,  tha  prototype  progra*  ia  baing  davalopad 
using  a  subaat  of  tha  availabla  spactral  estlma- 
tion  tachniquas.  As  with  othar  knowladga-baaa 
systaaa  (priaarily  expert  aystaaa)  parforaanca 
datarioratas  whan  tha  signal  analysad  falls  out- 
sida  tha  acopa  of  tha  knowladga-baaa  (SI. 
Tharafora.  tha  davalopaant  of  tha  I4UI  systaa 
will  ba  a  continual  procaaa  with  tha  knowladga 
basa  baing  expanded  with  aaeh  vara  loo  of  tha 
prograa. 

Knowledge  mm  slew 

Tha  first  stop  in  tha  development  of  tha 
K-BASE  program  ia  tha  spaclf leation  of  tha  know¬ 
ladga  basa.  Praliminary  studios  iM  ate  that 
thara  ara  four  ganaral  knowladga  dot  .  .ns  to  ba 
considarad  in  tha  davalopaant  of  tha  knowladga 
basa.  Thaaa  domains  includai 

-  Tha  knowladga  domain  aaaoeiatad  with  tha 
spactria  astlaatlan  tachniquas, 

-  Tha  data  modala  and  tha  a  priori  infor¬ 
mation  assoc iatad  with  tha  generation  of 

tha  tima  aarlos. 

-  Tha  signal-to-aymbol  transformation,  and 

-  Signal  processing  and  signal  manipulation 
techniques 

Tha  knowladga  domain  of  tha  spectrum  estima¬ 
tion  techniques  includes  a  variety  of  different 
types  of  information.  At  tha  highest  level  with¬ 
in  this  doawln  is  a  list  of  tha  various  powar 
spectrum  estimation  tachniquas,  i.e.,  the  esti¬ 
mation  tools  used  in  deriving  information  for 
making  inferences  and  deductions  about  tha  tima 
series  structure.  For  each  of  these  tachniquas 
there  is  a  catalogue  of  information  which 
specifies  the  characteristics,  behavior,  and 
limitations  about  tha  estimate  produced  by  tha 
technique.  For  example,  it  will  be  important  to 
specify  the  ways  in  which  a  spectrum  estimate  is 
affected  by  variations  of  such  parameters  as  the 
order  of  an  AX  or  AXMA  model,  the  time  series 
record  length,  the  number  of  autocorrelation 
lags,  and  the  type  of  spectral  or  data  record 
window.  Another  important  piece  of  knowledge 
Includes  the  strengths  and  limitations  of  ths 
spectral  estimation  technique.  Included  in  this 
area  would  be  information  concerning  the  data 
types  for  which  the  technique  is  best  suited. 
The  maximum  entropy  method  (MM),  for  example, 
performs  very  wall  for  time  seriss  which  may  be 
accurately  modelled  as  an  AX  process. 
Pisarenko's  method,  on  the  other  band,  works  very 
well  for  pure  tones  (sinusoids)  in  white  noise. 
Equally  important  is  information  concerning  the 
performance  of  the  technique  when  it  operates  on 


data  which  does  not  fit  the  assumed  model  as  well 
as  lists  of  potential  problems  associated  with  a 
given  technique  operating  a  certain  classes  of 
signal.  For  example,  it  will  be  important  to 
know  for  what  types  of  signals  and  with  what 
types  of  spectral  estimation  techniques  line 
splitting  is  likely  to  occur.  As  another 
exmaple,  it  will  be  important  to  know  when  a 
spectrum  estimation  procedure  produces  biased 
estimates  of  spectral  peaks.  In  other  words,  the 
knowledge  domain  associated  with  the  power 
spectrum  estimation  techniques  should  be  an  ex¬ 
haustive  catalogue  of  information  and  facts  about 
each  estimation  procedure. 

The  second  domain  of  knowledge  concerns 
information  about  the  signal  which  is  being 
analysed.  Mlthin  this  domain  falls  such  informa¬ 
tion  as  the  data  model  and  a  priori  information 
associated  with  the  generation  of  the  time 
series.  The  physics  of  wave  propagation  within 
geological  formations,  for  example,  provides 
information  about  seismic  time  series  records. 
The  theory  of  speech  production,  on  the  other 
hand,  provides  useful  models  which  may  be  used  in 
describing  the  time  series  representing  speech 
waveforms. 

The  third  knowledge  domain,  which  tradition¬ 
ally  is  not  usually  considered  to  be  a  part  of  a 
knowledge  base,  is  a  slgnal-to-eymbol  transforma¬ 
tion  [31.  This  s ignal- to-symbol  transformation 
provides  a  convenient  means  for  storing  and  mani¬ 
pulating  conceptually  inferred  information  about 
a  signal  or  its  estimated  spectrum.  Signal-to- 
symbol  transformations  are  accomplished  by  a 
g ranter  which  parses  the  tine  series  IS]  and  can 
lead  to  representations  of  the  formi 

IWTEXVAL  SYMBOLIC  RKPRBSE1ITATI0M 

10kHz  to  20k Hx  FLOOR— >CUSP->KI5E->CAP—>HAMP 

This  symbolic  representation  may  have  a  quanti¬ 
tative  description  associated  with  each  symbol 
such  ss  the  level  of  the  floor,  the  slope  of  a 
rise  or  a  ramp,  the  minimum  value  of  a  cusp,  or 
the  area  under  a  cap  [7].  The  primary  reason  for 
including  this  signal  grammar  in  the  knowledge 
base  is  to  allow  for  the  possibility  of  incor¬ 
porating  knowledge  about  how  the  grammar  is 
structured,  how  it  is  designed,  and  what  its 
characteristics  snd  features  are. 

The  last  knowledge  dosuiin  contains  the  sig¬ 
nal  processing  and  the  signal  manipulstion 
techniques.  Thess  techniques  Include  such  opera¬ 
tions  as  filtering,  windowing,  and  the  removal  of 
sinusoids.  They  are  intended  to  be  used  as 
additionsl  tools  to  further  enhance  a  signal  or 
its  spectrum  estimate  to  test  various  hypo¬ 
theses.  More  specifically,  after  an  initial 
analysis  is  performed,  s  set  of  hypotheses  are 
made.  Following  this  analysis,  ether  techniques 
may  be  invoked  in  order  to  help  confirm  or  dis¬ 
prove  these  hypotheses,  thus  increasing  the 
confidence  of  inferences.  For  example,  it  has 
been  recently  observed  that  for  the  ease  in  which 


two  closely  spaced  spectral  peaks  are  not  resolv¬ 
ed  by  a  high  resolution  spectral  estimation 
technique  such  as  MM,  the  peaks  may  often  -  be 
resolved  by  placing  seros  in  the  spectrum 
(usually  in  an  adaptive  fashion)  {8],  Zero 
insertion,  therefore,  is  viewed  as  a  potentially 
useful  tool  for  confirming  the  existence  of 
multiple  smeared  peaks  or  for  checking  for  the 
possibility  of  spectral  line  splitting.  For  each 
signal  processing  technique  coneidered,  knowledge 
about  its  properties,  limitations,  and  desired 
goals  needs  to  be  identified. 

The  development  of  a  total  system  to  handle 
all  types  of  specturm  estimation  techniques, 
various  types  of  signals,  many  signal  parsing 
grammars,  and  general  signal  processing  techni¬ 
ques  is  a  formidable  task.  Thus,  the  knowledge 
base  to  be  initially  developed  will  be  limited  in 
scope.  Concentration  is  being  focussed  on  a 
small  number  of  spectral  estimation  techniques 
and  attention  is  being  directed  towards  a  speci¬ 
fic  class  of  signals.  However,  as  the  knowledge 
base  evolves,  other  information  in  the  fora  of 
additional  power  spectrum  estimation  techniques 
and  signal  classes  will  be  incorporated. 

Control  Strategy 

The  control  strategy  provides  the  mechanism 
to  progress  fora  the  initial  state  (unknown 
signal)  to  the  goal  state  (signal  description). 
It  directs  the  search  through  the  problem 
space.  The  initial  state  is  the  sequence  of 
samples,  and  the  goal  state  night  be: 

Two  sinusoids  in  white  noise  at 
frequencies  10kHz  and  20kHz  with 
equal  power)  signal-to-noise  ratio 
4dB. 

Since  the  desired  output  of  a  spectrum  esti¬ 
mation  program  is  typically  answers  to  questions 
such  as  *are  there  one  or  two  sinusoids,*  the 
control  structure  uses  a  goal-directed  or  forward 
chaining  control  strategy  to  generate  a  set  of 
initial  hypotheses  [9],  Based  on  this  initial 
set  of  hypotheses,  additional  signal  processing 
and  signal  analysis  is  performed  to  evaluate  the 
probability  of  each  hypothesis.  For  example,  if 
the  initial  pass  deduces  that  either  one  or  two 
sinusoids  are  present  in  the  time  series,  then 
the  controller  analyses  the  data  record  in  the 
context  of  this  hypothesis.  The  second  pass  uses 
a  mixed  strategy  (e.g.  means-ends  analysis)  to 
determine  the  characteristics  of  the  sinusoids 
and  the  confidence  level  of  the  analysis. 

Knowledge  Best eeemtat ion 

In  the  K-BASE  system,  different  types  of 
knowledge  are  used  in  the  knowledge  base.  There 
is  the  slgnal-to-symbol  transformer,  the  rela¬ 
tional  information  associated  with  the  spectral 
estimation  techniques  and  their  properties,  and 
the  rules  for  bow,  when,  and  what  to  extract  from 
each  power  spectrum  estimate  generated.  Thera 
are  a  number  of  different  ways  of  representing 


knowledge.  Ato  common  methods  are  the  use  of 
production  rules  and  the  use  of  semantic 
frames.  In  K-BASE,  both  of  these  forms  are  used 
in  knowledge  representation.  For  example,  since 
the  knowledge  about  how  to  use  the  set  of  spec¬ 
tral  estimation  techniques  is  in  the  form  of 
rules,  production  rules  are  used.  Knowledge 
about  the  properties  and  limitations  of  a  given 
power  spectrum  estimation  technique,  on  the  other 
hand,  is  easier  to  represent  in  terms  of  rela¬ 
tions.  Semantic  frames  provide  a  convenient 
mechanism  for  representing  this  relational  know¬ 
ledge.  The  symbolic  representation  of  the  power 
spectrum  estimate  is  also  in  a  relational 
(sequential)  form  and  is  therefore  also  easily 
represented  in  the  form  of  semantic  frames. 

Subset  of  Knowledge 

The  development  of  a  knowledge-based  power 
spectrum  estimation  system  which  includes  all 
estimation  techniques  is  impractical  as  an 
initial  attempt.  The  first  prototype  system, 
therefore,  concentrates  on  a  selected  number  of 
spectral  estimation  techniques.  In  the  K-BASE 
program,  the  spectral  estimation  techniques 
chosen  are  the  periodiogram,  the  maximum  entropy 
method  (MSI),  and  Pisarenko's  method.  These 
methods  were  selected  since  they  produce  very 
different  spectrum  estimates. 

In  addition  to  constraining  the  spectrum 
estimation  methods  used  in  the  K-BASE  program, 
the  types  of  signals  are  also  constrained. 
Specifically,  the  program  focusses  its  attention 
on  relatively  low  order  (N«4)  AH  processes  to 
which  sinusoids  have  been  added. 

A  promising  technique,  zero  insertion  [8] , 
will  also  be  included  as  a  technique  to  analyze 
signals.  This  technique  is  not  a  spectrins  esti¬ 
mation  technique,  but  a  method  to  process  the 
signal  to  resolve  ambiguity.  It  relies  on  an 
Initial  hypothesis  of  the  characteristics  of  the 
attempts  to  do.  These  type  of  signal  manipula¬ 
tion  techniques  should  be  of  great  use  in  an  AR 
system  to  accomplish  spectral  estimation. 

The  development  of  the  K-BASE  program  on  a 
subset  of  the  spectral  estimation  knowledge-base 
will  not  be  as  powerful  as  using  all  spectral 
estimation  techniques,  for  all  signal  types,  with 
all  signal  modification  procedures.  It  is  hoped 
that  the  subset  knowledge-base  will  demonstrate 
the  feasibility  and  prove  useful  for  the  class  of 
problems  for  which  its  knowledge  covers.  The 
development  of  a  knowledge-base  system  is  an  on 
going  process  of  development-test-upgrade.  It  is 
ant lp tested  that  other  areas  of  knowledge  may  be 
included  in  later  versions. 


The  K-BASE  program's  goal  is  to  automate  the 
analysis  of  the  power  spectrum  based  on  estimates 
generated  by  a  variety  of  techniques.  To  infer 
information  about  the  true  power  spectrum  from  a 


variety  of  PSE  techniques  requite*  the  use  of 
knowledge .  An  artificial  Intelligence  approach 
appears  to  be  suited  to  this  problem. 


The  knowledge  base  is  cow  posed  of  four  major 
parts:  the  signal-to-sy*bol  transformer,  the 
spectral  estimation  techniques,  the  type  of 
signals,  and  the  signal  manipulation 
techniques.  A  control  strategy  directs  the 
search  for  the  desired  goal  state  (description  of 
the  true  power  spectrum).  The  strategy  is  to 
reason  forward  to  a  set  of  hypothesis,  then  use  a 
mixed  strategy  to  determine  a  aore  detailed 
analysis  with  confidence  factors.  The  initial 
knowledge  base  is  limited  in  scope  to  a  few 
spectral  estimation  techniques  and  for  a  specific 
signal  generation  aodel.  This  will  fora  the 
foundation  for  further  extensions  of  the 
knowledge  base. 
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